(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen dee brevets 



(12) 



(ID EP 0 565 947 B1 

EUROPEAN PATENT SPECIFICATION 



(45) Date of publication and mention 
of the grant of the patent: 
28.05.1997 Bulletin 1997/22 

(21) Application number: 93105323.5 

(22) Date of filing: 31.03.1993 



(51) Intel* H04B 14/04 



(54) Procedure for including digital information in an audio signal prior to channel coding 

Verfahren zum Einfugen digitaler Daten in ein Audiosignal vor der Kanalkodierung 
Methode pour inclusion d'information digitate dans un signal audio avant decoder le canal 



CD 

o> 

!S 

o 

Ql 
HI 



(84) Designated Contracting States: 
DE FR GB IT 

(30) Priority: 13.04.1992 Fl 921644 

(43) Date of publication of application: 
20.10.1993 Bulletin 1993/42 



(73) Proprietor: NOKIA TECHNOLOGY GmbH 
75175 Pforzheim (DE) 

(72) Inventor: Kuusama, Juha 
SF-33720 Tampere (Fl) 



(56) References cited: 
EP-A- 0137 855 
WO-A-89/10661 



EP-A- 0167 364 
US-A-5 136 586 



Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give 
notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in 
a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 
99(1) European Patent Convention). 



Printed by Jouve. 75001 PARIS (FR) 



1 



EP 0 565 947 B1 



2 



Description 

The present invention relates to a method with 
which data information can be added in an audio signal 
present in digital form so that after the channel coding 
of an audio signal accomplished in a transmitter and the 
coding of an audio signal accomplished in a receiver no 
information is lost. 

In a conference proceedings paper Proc. ICASSP 
90, Alberquerque, New Mexico, April 3-6, 1990, p. 
1097-1100, W.ten Kate, L van de Kerkhof and F. Zider- 
veld: Digital Audio Carrying Extra Information, a encod- 
ing method is described with which a four-channel audio 
signal can be encoded to be appropriate for use in a 
transmission path of a two-channel audio signal. In said 
encoding method two characteristic features of the hu- 
man hearing sense are made use of: hearing threshold 
and masking effect. The masking effect means that in 
any audio signal another, less powerful signal can be 
added, which is not audible to the ear because of the 
masking effect. The masking effect is a psychoacoustic 
phenomenon in which the hearing threshold moves up- 
wards when other sounds are present. The masking ef- 
fect is most successful in sounds in which the spectrum 
components are in the proximity of the components of 
the masking sound. The frequency masking declines 
more rapidly when moving to lower sounds. This is true 
also in the time plane: the masking effect is greatest in 
sounds which are simultaneously audible. The depend- 
ence of the masking effect on time and frequency is well 
known in simple signals. The existence of masking ef- 
fect can be utilized in that signals below the hearing 
threshold can be added into an audio signal. In principle, 
this takes place so that an analogous audio signal is 
sampled and in the place of the bits of the samples not 
audible to the human ear other information is placed. 
Thus, information is inserted in place of the less signif- 
icant bits of the sample in digital form. When such a sig- 
nal is repeated, the human ear is not at all able to hear 
the signal added therein because the actual signal in- 
tended to be heard masks it. It is the masking ability of 
the human ear which determines how many less signif- 
icant bits can be substituted without still being audible. 
A signal thus added can be used for various purposes. 
Similarly, when a sound signal is compressed, the sig- 
nals below the hearing threshold can be excluded from 
storage, or only the signals audible to the human ear 
are transmitted. 

The principle of said known coding method utilizing 
the masking effect is presented in Fig. 1 . An incoming 
audio signal is sampled and divided first in a filter bank 
1 into a great number of subbands and the signal sam- 
ples of the subbands are decimated in means 2. The 
subbands are preferably equal in size so that the sam- 
pling frequency meeting the Nyqvist criterion in the dec- 
imalizing means 2 of each subband is equal. The sam- 
ples of each subband are then grouped into subsequent 
time windows in means 3. The length of a time window 



is A t and it includes samples of one and same point of 
time from each subband. So, the simultaneous time win- 
dows of each subband constitute one block. A power 
spectrum is calculated for each block in spectrum anal- 
5 ysis means 4 and from the spectrum thus derived a 
masking threshold is determined for each block in 
means 5. After determining the masking threshold it is 
clear what the maximum signal power is which can be 
added in an audio signal of a subband in said time win- 
io dow. DATA IN bits of the data signal are added below 
the masking threshold calculated for the audio signal. It 
is carried out so that a given number of subsequent bits 
of a data flow, e.g. three subsequent bits, form one word. 
Each word is interpreted to be an address representing 
is a given sample value; thus, in a three bit case there are 
eight pieces of sample values. Selection of a word and 
the sample value corresponding thereto is carried out in 
means 6. The sample values are grouped for appropri- 
ate sample windows of the subbands corresponding to 
the equivalence of the sample value and the threshold 
of the sample window of a subband, and data bits are 
substituted for bits of the audio signal samples of a sub- 
band in an adder 7. After the substitution, the sample 
frequency of the signals of the subbands is increased in 
means 2, and the signals are again connected in the 
filter bank 9 into a wide-band audio signal which to a 
listener sounds totally similar to the original audio signal 
although data information has been added therein. The 
reception is in principle a reverse incident to the trans- 
mission. A typical feature in this method of prior art is 
that a hearing threshold benefitting the masking effect 
has to be calculated both in the encoder of the transmit- 
ter and in the decoder of the receiver by using a mask 
modelling model of the human hearing system (i.e. Psy- 
cho Acoustic Model). Thus, the encoder and the coder 
act independent of one another. This results in certain 
problems. 

In the Finnish patent application No. 915114, filing 
date October 30, 1991, corresponding to EP-A-0 540 
330, published 05 May 1993, said application being in- 
cluded as reference in the present application, the infor- 
mation produced by the encoder of the above described 
system is made use of. Such information includes infor- 
mation concerning data mode, information related to 
quantisation, and information related to dematrixing. 
Said information is transmitted on a separate side chan- 
nel at the same time as the audio signals to a receiver, 
which controlled by side channel information is enabled 
to process the two-channel audio signal received and to 
convert it e.g. into a multichannel audio signal. Thus, 
the coder of the receiver acts controlled by the transmit- 
ter encoder, i.e. as a slave decoder. An audio signal 
transmitted on a stereo channel and the information da- 
ta hidden therein are therefore separated using the con- 
trol information transmitted by the encoder and received 
on a separate channel. 

The principle of the Finnish patent application is 
shown in Fig. 2. A coding block therein is indicated by 
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reference numeral 31 , said block being in essential el- 
ements similar to the prior art encoding block shown in 
Fig. 1 . The encoder combines an incoming multichannel 
audio signal into a combined stereo signal ■hiding" a da- 
ta signal therein by making use of the masking effect. 
Information about the data mode, quantization and ma- 
trixing are received from the encoder. The data mode 
describes the special arrangements needed for maxi- 
mizing the transmission capacity of the hidden data. 
Such arrangements are e.g. information about that cer- 
tain channels contain no signals compared with the 
state of the rest of the channels, so that after being cod- 
ed said channels are attenuatabie. On the whole, the 
mode contains the way of processing the special in- 
stances concerning signal coding when these are not 
included in normal mix-up. The quantization data in- 
forms of the quantization steps of the masking signal 
and the signal to be masked (hidden), and the number 
of bits as well as the masking threshold calculated for 
the time intervals of each subband in the manner de- 
scribed above. The matrixing information yields infor- 
mation about how the original multichannel audio signal 
was downmixed. In brief, ail the information required in 
carrying out the coding can be achieved from the en- 
coder. The combined stereosignal derived from the en- 
coder, in which data has been "hidden - , is adapted for 
the audio signal to be used on a radio path to be trans- 
mitted to e.g. the NICAM format. The above information 
required in coding is transmitted simultaneously on a 
separate low-speed digital channel. If the data hidden 
in the audio channel cannot at a point of time be included 
in the audio channel, because the "masking capacity* 
of the audio signal does not suffice, said data can be 
transmitted on said separate data channel, the informa- 
tion transmitted whereon can be called side information 
because it is transmitted on the side of the actual audio 
channel. 

The coder 32 in the receiver receives the signal of 
the audio channel and the side information of the data 
channel, so that controlled by the coding information 
transmitted therein it is enabled to code the signal of the 
audio channel and to separate the data hidden therein. 
Controlled by the matrixing information it is further ena- 
bled to form e.g. a multichannel audio signal. 

The method of said Finnish patent application is in 
principle well appropriate for use in transmitting an audio 
signal containing hidden data on a transmission path, 
one of its application being the sound transmission of 
any HDTV system. In transmitting an audio signal digit- 
ally through the radio, it must first be encoded to be ap- 
propriate for a transmission channel. There are a great 
number of channel-coding systems available using 
compressing; the NICAM system may be mentioned 
here as an example thereof, as it is already in use and 
as it may become the audio transmission system in the 
European HDTV system. When the above-described 
method is applied in the audio signal, which is channel- 
coded thereafter using any existing method, this raises 



a difficult problem in practice: the received coded audio 
signal is not precisely the same as the audio signal of 
the transmissbn head prior to channel-coding. This is 
due to the fact that independent on the system, the 
s channel-coding causes errors. Most often, one or two of 
the least significant bits may become converted in the 
encoder, so that the coded bit stream is almost, but not 
precisely, the same as the bit stream prior to the encod- 
ing. Consequently, if an audio signal is used as such in 

io a transmitter as a signal masking some data to be hid- 
den, it would lead either to a significant increase in error 
rate of the bits being transmitted or to a significant drop 
in the hiding capacity because the data is hidden spe- 
cifically by substituting the least significant bits. 

is According to the invention, this problem can be 
solved using the characteristic feature of the method 
disclosed in the Finnish patent application No. 915114, 
said feature meaning a separate side information chan- 
nel containing information formation for controlling the 

20 encoder. Since not only on the amount of the data to be 
used is transmitted on said side channel, as suggested 
in the application, but also precise information on the 
location of said data samples, an immaculate original 
data signal can be provided with the aid of said informa- 

25 tion. Knowledge of the location of the data samples pre- 
requires information about which of the least significant 
bits of the audio signal can be substituted for data infor- 
mation, that is, which of the bits are sure to pass through 
the channel-coder without being changed. 

30 This information is described according to claim 1 . 
The insight of the invention lies in that an original 
audio signal is separated into two branches, in the first 
of which the signal is first channel-coded and immedi- 
ately thereafter it is decoded. In the second branch the 

35 signal is delayed as long as in the first branch the signal 
is encoded and coded. In this step such signals are re- 
sulted which almost resemble one another: in the signal 
of the first branch the encoding/decoding operation 
caused a few bit errors. Thereafter, the audio signals of 

40 both branches are divided into a plurality of subbands 
in the filter bank and the signal samples of the subbands 
are decimated. The subbands have to be equal in size. 
In each branch the samples of every subband are then 
grouped into subsequent time windows. The length of 

45 one time window is A T and it includes samples of the 
same point of time from each subband. The simultane- 
ous time windows of each subband thus form each time 
one block. Now, the equivalent samples of the subbands 
of each branch block are mutually comparable. If all bits 

50 are the same it is known that said bits have not been 
affected by the channel-coding. If, instead, e.g. the low- 
est, i.e. the least significant bit of the sample of the en- 
coding/coding branch differs from the lowest bit of the 
sample of the non-encoded branch, while the rest of the 

ss bits are equal, said lowest bit is known to be a bit not 
expected to outlast the channel-coding operation, so 
that a data bit is not substituted therefor. Part of the other 
bits can be replaced by data bits because they are 
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known to outlive in channel coding. This is the method 
which is used for all subbands. The masking threshold 
is then calculated for the audio signal and the data to be 
hidden is added in place of the bits of the audio signal 
which are known to outlive. The information about which 
of the bits in each sample have been substituted is in- 
cluded in the side channel information SI, on the basis 
of which the receiver is able to reconstruct the correct 
hidden information precisely. 

An implementation of the invention is described be- 
low, reference being made to the accompanying sche- 
matic figures, in which: 

Fig. 1 presents an encoder used in the method of 
prior art, 

Fig. 2 shows the coder as disclosed in the Finnish 
appliation No. FI-915114, and 

Fig. 3 shows principally the procedure of the inven- 
tion. 

The procedures shown in Figs 1 and 2 are already 
described above. The principle of the method according 
to the invention is presented in Fig. 3. A digital audio 
signal AUDIO IN, within which DATA IN data information 
has been hidden utilizing the masking effect, is separat- 
ed into two branches. In the upper branch the audio sig- 
nal is channel-coded in an encoder 325 using the same 
coding method as used in the actual transmission path, 
for instance in the NICAM coding. An audio signal chan- 
nel-coded immediately thereafter is coded in a coder 
316, whereby it should result in the original audio signal. 
The audio signal AUDIO IN is at the same time conduct- 
ed also into the lower branch in which it is delayed in a 
delay means 317 precisely the time which passes for 
the encoding and coding in the upper branch. In the in- 
terface, marked with , the audio signals are not, how- 
ever, bit by bit the same, owing to errors caused by the 
encoder 325 and decoder 316. The defective bits are 
found by dividing the audio signal in the filter banks 31 
and 311, after the interface P v into a plurality of sub- 
bands, and the signal samples of the subbands are dec- 
imated in means 32 and 312. Said subbands are pref- 
erably equal in size. The samples of each subband are 
thereafter grouped into subsequent time windows in 
means 33 and 315. The lengths A T of the time window 
are the same and they include the same amount of sam- 
ples of one and same point of time from each subband. 
Thus the simultaneous time windows of each subband 
always form one block. So, at one point of time, the sig- 
nal samples of both the branch of the coded audio signal 
and of the branch of the delayed audio signal are known, 
grouped according to their frequency bands. The sam- 
ples of one point of time are then compared in a com- 
parator 313 so that a sample of one subband of means 
33 is compared with a sample of the correspondent sub- 
band of means 315. If the encoding / coding process 
has changed any of the bits, the comparison reveals 
which of the bits were changed. For instance, if the low- 



est, i.e. the least significant bit in a sample of block 33 
is different from the one in the sample of block 315, it is 
known that no data bit should be placed in the place of 
said bit because it will in any case be lost in the course 

6 of channel-coding. After the interface marked with P 2 it 
was thus found out which of the bits of the audio signal 
should not be substituted for by data bits. The essential 
core of the invention lies precisely in this fact, and the 
information obtained thereafter can be applied in an en- 

io coder complying with the Finnish application No. 
915114. The mode of operation is described below in 
outline. 

A spectrum analysis is accomplished in a manner 
known in the art in the lower branch in means 34 and 

T5 the calculation of the masking threshold in means 35. 
After finding out how many of the bits of the audio signal 
can be substituted for by data bits and which of the bits 
in the audio signal do not outlive the channel-coding, 
only the bits below the masking threshold can be sub- 

20 stituted in an adder 31 0 which outlive in the channel cod- 
ing. On the basis of the masking threshold information 
by block 35 and the information provided by reference 
block 313, the data to be hidden is arranged to be ap- 
propriate in an arrangement block 36. 

25 The information divulged in reference means 31 3 is 
conveyed to the adder 310. For instance, if the spectrum 
analysis and the calculation of the masking threshold 
indicate that data bits could be substituted for three bits 
in a sample, without being audible to the human ear, and 

30 if it has been analysed in reference means 31 3 from the 
same sample that the first bit will perish in the channel- 
coding process, only the two bits of the sample are sub- 
stituted for by data bits which were learnt to outlive the 
channel coding. The information on the point of a sam- 

35 pie of an audio signal at which some data has been hid- 
den, i.e. which of the bits have been substituted for by 
data bits, is transmitted as side information on a SI chan- 
nel. On the basis of said information and other informa- 
tion transmitted on the side channel, the receiver is en- 

40 abled to discover in the audio signal a data signal hidden 
therein. 

All audio samples are analysed similarly in each 
subband, regarding the duration of the channel coding, 
and only those bits below the masking threshold are 

45 substituted which are sure to outlive the channel-coding. 
After summing up, the sample frequency of the signals 
of the subbands is increased in means 38 and the sig- 
nals are recombined in filter bank 3d into a wideband 
audio signal which after being channel-coded in the 

50 transmitter and decoded in the receiver sound to the lis- 
tener's ear the same as the original audio signal irre- 
spective of the fact that data information has been add- 
ed therein and that the data information is received with- 
out any deficiencies. A low-speed side channel SI is pro- 

55 duced in the manner disclosed in Finnish application No. 
915114, included therein an addition that now also in- 
formation about the location of the bits hidden therein is 
added therein. 
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The main features of the method are described 
above. It is obvious that a practical implementation can 
be accomplished in a number of ways while remaining 
within the protective scope of the claims. The method is 
particularly appropriate for use in association with the 
method disclosed in Finnish patent application. No. 
915114 because the side channel disclosed therein is 
particularly well appropriate for mediating the informa- 
tion about the location of the substituted bits to the re- 
ceiver. 



Claims 

1 . A method for combining a data signal with an audio 
signal prior to channel-coding the combined signal, 
in which 

an audio signal entering in sample sequence 
mode is conducted to a first branch and divided 
into subbands, whereby in each subband an ar- 
ray of audio signal samples of equal size is ob- 
tained in one and the same time window, 
a masking threshold is calculated simultane- 
ously for said sample array in each subband, 
the sounds wherebelow being unaudible to the 
human ear, 

the bits of the data signal are substituted for the 
bits of the samples of the sample arrays re- 
maining below the masking threshold, 
the subbands are combined, whereby a com- 
bined signal to be transmitted on an audio 
channel is obtained, and 
all the information is gathered that is needed in 
re-separating the combined signal, and said in- 
formation is transmitted in the form of side in- 
formation on a separate data channel at the 
same time with the combined signal, 

whereby 

an audio signal is conducted also to a second 
branch in which it is channel-coded and decod- 
ed, and thereafter it is divided into as many sub- 
bands as in the first branch, whereby in each 
subband an array of audio signal samples of 
equal magnitude is obtained in the same time 
window as in the first branch, 
the audio signal conducted into the first branch 
is delayed for a time equivalent to the time re- 
quired for channel-coding and decoding, 
the audio signal samples of one and same point 
of time of the corresponding subbands of each 
branch are compared, 

only the bits of the samples of the first branch 
are substituted for by data bits which are the 
same as in the second branch, and 
information on the location of the substituting 



data bits in the sample is transmitted in the form 
of side information on said data channel. 

2. Method for separating an audio signal and a data 
s signal combined in the manner disclosed in claim 1 
in a receiver in which a signal entering in sample 
sequence mode is coded, divided into subbands, 
and the bits are separated from the combined signal 
which remain below the masking threshold, and the 
10 separated bits are combined, whereby the receiver 
receives in the form of side information on a sepa- 
rate data channel such information which is needed 
for separating the data signal from the audio signal, 
whereby the decoder accomplishes said separation 
is controlled by the coder, characterized in that the 
side information also includes information about 
which of the bits in the audio sample have been sub- 
stituted for by data bits. 

20 3. An apparatus for combining a data signal with an 
audio signal before channel-coding the combined 
signal in the transmitter, said apparatus comprising: 

a first filter means (311) for dividing an audio 
25 signal entering in the form of sample sequence 

mode into subbands, 

a grouping means (315) to group in each sub- 
band an array of audio signal samples of the 
same size in one and same time window, 
30 - an analysing and calculating means (34,35), si- 
multaneously calculating in each subband a 
masking threshold for a sample group, the 
sounds below which the human ear is not able 
to hear, 

35 a substituting means (37) in which the bits of a 

data signal are substituted for the bits of the 
samples of the sample groups which remain 
bebw the masking threshold, 
a second filter means (39) to combine the sub- 

40 bands, whereby a combined signal to be trans- 

mitted on an audio channel is obtained, 
a data channel control means to gather all the 
information needed for reseparating the com- 
bined signal, which information is transmitted 

45 as side information on the data channel simul- 

taneously with the combined signal, 

whereby the apparatus comprises further 

50 - a parallel branch to which the audio signal is 
also conducted, while the branch comprises in 
succession a channel-coder (325) and a de- 
coder (316), a third filter means (31) to divide 
the output signal of the encoder into as many 

ss subbands as the first filter means (31 1 ), a sec- 

ond grouping means (33) to group within each 
subband an equal number of audiosignal sam- 
ples in one time window, whereby in said sub- 
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band an equal number of audiosignat samples 
are obtained in one and the same time window 
as in the first branch, 

a delay means (317) to delay the audio signal 
entering the first filter means (31 1 ) for a period s 
of time which corresponds to the delay of the 
channel coder (315) and the decoder (316), 
a comparator means (31 3) which compares the 
same-moment audio signal samples of the cor- 
responding subbands of the first (315) and the 10 
second grouping means (33) with one another, 
whereby the substituting means substitutes 
with data bits only for the bits of the samples of 
the first grouping means (315) which are the 
same as those in the samples of the second is 
grouping means (33), and the comparator (313, 
314) informs the control means of the side 
channel of the location of the substituting data 
bits in the sample. 



Patentanspruche 

1 . Verfahren zum Kombinieren eines Datensignals mlt 
einem Tonsignal vor der Kanalcodierung des kom- 25 
binierten Signals, bei dem 

ein im Abtastsequenzmodus eingehendes Ton- 
signal zu einer ersten Verzweigung geleitet und 
in Teilbander unterteilt wird, so daG in jedem 30 
Teilband eine Reihe von Tonsignalproben glei- 
cher GroGe in ein und demselben Zeitfenster 
erhalten wird, 

fur die genannte Probenreihe gleichzeitig in je- 
dem Teilband eine Maskierungsschwelle er- 35 
rechnet wird, unterhalb derer die Tone f Or das 
menschliche Ohr unhorbar sind, 
die Bits des Datensignals durch die Bits der 
Proben der unter der Maskierungsschwelle 
verbleibenden Probenreihen substituiert wer- *o 
den, 

die Teilbander kombiniert werden, so daG ein 
auf einem Tonkanal zu ubertragendes kombi- 
niertes Signal erhalten wird, und 
alle Informationen gesammelt werden, die *s 
beim erneuten Trennen des kombinierten Si- 
gnals benotigt werden, und diese Informatio- 
nen in der Form von Nebeninformationen auf 
einem separaten Datenkanal gleichzeitig mit 
dem kombinierten Signal ubertragen werden, so 
wobei 

ein Tonsignal auch zu einer zweiten Verzwei- 
gung geleitet wird, in der es kanalcodiert und 
-decodiert und danach in ebenso viele Teilban- 
der wie in der ersten Verzweigung unterteilt ss 
wird, so daG in jedem Teilband eine Reihe von 
Tonsignalproben gleicher GroGe in demselben 
Zeitfenster erhalten wird wie in der ersten Ver- 



zweigung, 

das in die erste Verzweigung geleitete Tonsi- 
gnal fur eine Zeit verzogert wird, die gleich der 
Zeit ist, die zur Kanalcodierung und -decodie- 
rung eriorderlich ist, 

die Tonsignalproben von ein und demselben 
Zeitpunkt der entsprechenden Teilbander jeder 
Verzweigung verglichen werden, 
nur diejenigen Bits der Proben der ersten Ver- 
zweigung durch Datenbits substituiert werden, 
die dieselben sind wie in der zweiten Verzwei- 
gung, und 

Informationen uber den Ort der Substitution 
von Datenbits in der Probe in der Form von Ne- 
beninformationen uber den genannten Daten- 
kanal ubertragen werden. 

2. Verfahren zum Trennen eines Tonsignals und eines 
in der in Anspruch 1 offenbarten Weise kombinier- 
ten Datensignals in einem Empfanger, in dem ein 
im Abtastsequenzmodus eingehende6 Signal co- 
diert und in Teilbander unterteilt wird und diejenigen 
Bits von dem kombinierten Signal getrennt werden, 
die unterhalb der Maskierungsschwelle bleiben, 
und die getrennten Bits kombiniert werden, so daG 
der Empfanger in der Form von Nebeninformatio- 
nen auf einem separaten Datenkanal solche Infor- 
mationen erhalt, die zum Trennen. des Datensignals 
von dem Tonsignal erforderlich sind, so daG der De- 
coder die genannte Trennung durch den Codierer 
gesteuert durchfuhrt, dadurch gekennzeichnet, daG 
die Nebeninformationen auch Informationen dar- 
uber enthalten, welche der Bits in der Tonprobe 
durch Datenbits substituiert wurden. 

3. Vorrichtung zum Kombinieren eines Datensignals 
mit einem Tonsignal vor der Kanalcodierung des 
kombinierten Signals in dem Sender, wobei die ge- 
nannte Vorrichtung folgendes umfaGt: 

einen ersten Filter (31 1 ) zum Unterteilen eines 
im Abtastsequenzmodus eingehenden Tonsi- 
gnals in Teilbander, 

ein Gruppierungsmittel (315), urn in jedem Teil- 
band eine Reihe von Tonssignalproben dersel- 
ben GroGe in ein und demselben Zeitfenster zu 
gruppieren, 

ein Analyse- und Berechnungsmittei (34, 35), 
das gleichzeitig in jedem Teilband eine Maskie- 
rungsschwelle fur eine Probengruppe errech- 
net, unterhalb derer der Ton fOr das menschli- 
che Ohr nicht horbar ist, 
ein Substitutionsmittel (37), bei dem die Bits ei- 
nes Datensignals durch Bits der Proben der 
Probengruppen substituiert werden, die unter- 
halb der Maskierungsschwelle bleiben, 
einen zweiten Filter (39) zum Kombinieren der 
Teilbander, so daG ein auf einem Tonkanal zu 



6 



11 



EP0 565 947 B1 



12 



ubertragendes kombiniertes Signal erhalten 
wird, 

ein Datenkanal-Steuermittel zum Sammeln al- 
ler Informationen, die fur die erneute Trennung 
des kombinierten Signals benotigt werden, wo- 
bei diese Informationen als Neben informatio- 
nen gleichzertig mit dem kombinierten Signal 
auf dem Datenkanal ubertragen werden, wobei 
die Vorrichtung femer folgendes umfaGt: 
eine parallele Verzweigung, auf die das Tonsi- 
gnal ebenso geleitet wird, wahrend die Ver- 
zweigung nacheinander folgendes umfaBt: ei- 
nen Kanalcodierer (325) und einen Decodierer 
(316), einen dritten Filter (31) zum Unterteilen 
des Ausgangssignals des Codierers in ebenso 
viele Teilbander wie der erste Filter (311), ein 
zweites Gruppierungsmittel (33), urn innerhalb 
jedes Teilbandes eine gleiche Zahl von Tonsi- 
gnalproben in einem Zeitfensterzu gruppieren, 
so dal3 in dem genannten Teilband eine gleiche 
Zahl von Tonsignalproben in ein und demsel- 
ben Zeitfenster wie in der ersten Verzweigung 
erhalten werden, 

ein Verzogerungsmittel (317) zum Verzogern 
des in dem ersten Filter (311) eingehenden 
Tonsignals fur eine Zeitperiode, die der Verzo- 
gerung des Kanalcodierers (315) und des De- 
codierers (316) entspricht, 
einen Komparator (313), der die zeitgleichen 
Tonsignalproben der entsprechenden Teilban- 
der des ersten (315) und des zweiten (33) 
Gruppierungsmittels miteinander vergleicht, so 
daft das Substituierungsmittei nur diejenigen 
Bits der Proben des ersten Gruppierungsmit- 
tels (315) durch Datenbits substituiert, die die- 
selben sind wie die in den Proben des zweiten 
Gruppierungsmittels (33), und der Komparator 
(313, 314) informiert das Steuermittel des Sei- 
tenkanals des Ortes der substituierenden Da- 
tenbits in der Probe. 



Revendicatlons 

1 . Procede pour combiner un signal de donnees avec 
un signal audio avant de coder en canaux le signal 
combine, dans lequel 

un signal audio entrant dans un mode sequen- 
tiel d'echantillons est amen6 jusqu'S une pre- 
miere branche et divise en sous-bandes, 
moyennant quoi dans chaque sous-bande, un 
ensemble d'echantillons de signal audio de 
tallies egales est obtenu dans une seule et m3- 
me fendtre temporelle, 

un seuil de masquage est calcuie en m6me 
temps pour (edit ensemble d'echantillons dans 
chaque sous-bande ; les sons au-dessous de 



celui-ci etant inaudibles pour I'oreille humaine, 
las bits du signal de donnees viennent rempla- 
cer les bits des 6chantillons des ensembles 
d'echantillons restant sous le seuil de masqua- 

5 ge, 

les sous-bandes sont combin6es, moyennant 
quoi un signal combine* devant 6tre transmis 
sur un canal audio est obtenu, et 
toutas les informations sont rassembldes, qui 

io sont necessaires pour separer de nouveau le 

signal combine, et lesdites informations sont 
transmises sous la forme d'informations secon- 
dares sur un canal de donnees separe au me- 
me moment que le signal combine, moyennant 

is quoi 

un signal audio est egalement amene jusqu'6 
une seconds branche dans lequel il est code 
en canaux et decode, et par la suite, il est divis6 
en autant de sous-bandes que dans la premie- 

20 re branche, moyennant quoi, dans chaque 

sous-bande, un ensemble d'echantillons de si- 
gnal audio d'amplitudes egales est obtenu 
dans la m§me fendtre temporelle que dans la 
premiere branche, 

25 - le signal audio amend dans la premiere bran- 
che est retarde pendant une dur6e equivalente 
& cede requise pour coder en canaux et deco- 
der, 

les echantillons de signal audio d'un seul et m§- 
30 me instant des sous-bandes correspondantes 

de chaque branche sont compares, 
seuls les bits des Echantillons de la premiere 
branche sont remplac6s par des bits de don- 
nees qui sont les mSmes que dans la seconde 
3S branche, et 

les informations sur ['emplacement des bits de 
donnees de remplacement dans Techantillon 
sont transmises sous la formes d'informations 
secondares sur ledit canal de donnees. 

40 

2. Proc6d6 pour separer un signal audio et un signal 
de donnees combines de la maniere d 6c rite dans 
la revendication 1 , dans un rScepteur dans lequel 
un signal entrant dans un mode sdquentiel d'echan- 

45 tiilcns est code, divise en sous-bandes, et les bits 
sont s6par6s du signal combine qui restent au-des- 
sous du seuil de masquage, et les bits s6par6s sont 
combines, moyennant quoi le rdcepteur recoit sous 
la forme d'informations secondaires, sur un canal 

so de donnees separ6, les informations qui sont ne- 
cessaires pour separer le signal de donnees du si- 
gnal audio, moyennant quoi le decodeur realise la- 
dite separation commandee par le codeur, caracte- 
rise en ce que les informations secondaires com- 

sb prennent egalement des informations au sujet des 
bits dans l'6chantillon audio qui ont 6te remplaces 
par les bits de donnees. 
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3. Dispositif pour combiner un signal de donnSes avec 
un signal audio avant de coder en canaux le signal 
combin6 dans l'6metteur, ledit dispositif 
comprenant : 

5 

des premiers moyens de filtre (31 1 ) pour diyiser 
un signal audio entrant sous la forme d'un mo- 
de s6quentiel d'6chantillons en sous-bandes, 
des moyens de groupement (315) pour grouper 
dans chaque sous-bande un ensemble io 
d'6chantillons de signal audio de la m§me taille, 
dans une seule et m&me fendtre temporelle, 
des moyens d'analyse et de calcul (34, 35), cal- 
culant en m§me temps dans chaque sous-ban- 
de un seuil de masquage pour un groupe 16 
d*6chantillons, I'oreille humaine n'Stant pas ca- 
pable d'entendre les sons au-dessous de celui- 
ci f 

des moyens de substitution (37) dans lesquels 
les bits d'un signal de donndes remplacent les 20 
bits des 6chantillons des groupes d'Schan- 
tillons qui restent au-dessous du seuil de mas- 
quage, 

des deuxi&mes moyens de filtre (39) pour com- 
biner les sous-bandes, moyennant quoi un si- 25 
gnal combine devant 6tre transmis sur un canal 
audio est obtenu, 

des moyens de commande de canal de don- 
n6es pour rassembler toutes les informations 
ndcessaires pour sSparer de nouveau le signal so 
combine, lesquelles informations sont transmi- 
ses en tant qu'informations secondaires sur le 
canal de donn6es en m£me temps que le signal 
combind, le dispositif comprenant en outre 
une branche paralldle vers laquelle le signal & 
audio est 6galement amend, tandis que la bran- 
che comprend, k la suite, un codeur (325) de 
canaux et un d6codeur (316), des troisi&mes 
moyens de filtre (31) pour diviser le signal de 
sortie du codeu r en autant de sous-bandes que 40 
dans les premiers moyens de filtre (311), des 
seconds moyens de groupement (33) pour 
grouper & I'interieur de chaque sous-bande un 
nombre 6gal d'6chantillons de signal audio 
dans une fenStre temporelle, moyennant quoi *5 
on obtient dans ladite sous-bande un nombre 
6gal d'6chantillons de signal audio dans une 
seule et m§me fendtre temporelle comme dans 
la premi&re branche, 

des moyens de retardement (317) pour retar- so 
der le signal audio entrant dans les premiers 
moyens de filtre (311) pour une duree qui cor- 
respond au retard du codeur (31 5) et du d6co- 
deur (316) de canaux, 
- des moyens formant comparateur (313) qui 6$ 
comparent, les uns avec les autres, les 6chan- 
tiltons de signal audio, pris au mdme moment, 
des sous-bandes correspondantes des pre- 



miers (315) et seconds (33) moyens de grou- 
pement, moyennant quoi les moyens de rem- 
placement remplacent par des bits de donn6es 
seulement les bits des 6chantillons des pre- 
miers moyens de groupement (31 5) qui sont les 
m§mes que ceux dans les 6chantillons des se- 
conds moyens de groupement (33), et le com- 
parateur (313, 314) informe les moyens de 
commande du canal secondaire de I'emplace- 
ment des bits de donn6es de remplacement 
dans r^chantillon. 
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